准确地测量纳米颗粒的大小，形态和结构非常重要，因为它们在许多应用中都非常依赖其特性。在本文中，我们提出了一种基于深度学习的方法，用于根据扫描透射电子显微镜图像的少量数据集训练的纳米颗粒测量和分类。我们的方法由两个阶段组成：本地化，即检测纳米颗粒和分类，即其超微结构的分类。对于每个阶段，我们通过分析不同最新神经网络的分析来优化分割和分类。我们展示了如何使用图像处理或使用各种图像产生神经网络的合成图像的产生来改善两个阶段的结果。最后，将算法应用于双金属纳米颗粒，证明了大小分布的自动数据收集，包括复杂超微结构的分类。开发的方法可以轻松地转移到其他材料系统和纳米颗粒结构中。

骨质疏松症是一种常见疾病，可增加骨折风险。髋部骨折，尤其是在老年人中，导致发病率增加，生活质量降低和死亡率增加。骨质疏松症在骨折前是一种沉默的疾病，通常仍未被诊断和治疗。通过双能X射线吸收法（DXA）评估的面骨矿物质密度（ABMD）是骨质疏松诊断的金标准方法，因此也用于未来的骨折预测（Pregnosticic）。但是，所需的特殊设备在任何地方都没有广泛可用，特别是对于发展中国家的患者而言。我们提出了一个深度学习分类模型（形式），该模型可以直接预测计算机断层扫描（CT）数据的普通X光片（X射线）或2D投影图像。我们的方法是完全自动化的，因此非常适合机会性筛查设置，确定了更广泛的人群中的高风险患者而没有额外的筛查。对男性骨质疏松症（MROS）研究的X射线和CT投影进行了训练和评估。使用了3108张X射线（89个事件髋部骨折）或2150 CTS（80个入射髋部骨折），并使用了80/20分。我们显示，表格可以正确预测10年的髋部骨折风险，而验证AUC为81.44 +-3.11％ / 81.04 +-5.54％（平均 +-STD），包括其他信息，例如年龄，BMI，秋季历史和健康背景， X射线和CT队列的5倍交叉验证。我们的方法显着（p <0.01）在X射线队列上分别优于以70.19 +-6.58和74.72 +-7.21为70.19 +-6.58和74.72 +-7.21的\ frax等先前的方法。我们的模型在两个基于髋关节ABMD的预测上都跑赢了。我们有信心形式可以在早期阶段改善骨质疏松症的诊断。

高质量数据是现代机器学习的关键方面。但是，人类产生的标签遭受了标签噪声和阶级歧义等问题。我们提出了一个问题，即硬标签是否足以在存在这些固有的不精确的情况下代表基本的地面真相分布。因此，我们将学习的差异与硬和软标签进行定量和定性，以获取合成和现实世界数据集。我们表明，软标签的应用可改善性能，并产生内部特征空间的更常规结构。

一贯的高数据质量对于深度学习领域的新型损失功能和体系结构的发展至关重要。通常假定存在此类数据和标签的存在，而在许多情况下，获取高质量数据集仍然是一个主要问题。在现实世界数据集中，由于注释者的主观注释，我们经常遇到模棱两可的标签。在我们以数据为中心的方法中，我们提出了一种重新标记标签的方法，而不是在神经网络中实施此问题的处理。根据定义，硬分类不足以捕获数据的现实歧义。因此，我们提出了方法“以数据为中心的分类和聚类（DC3）”，该方法结合了半监督分类和聚类。它会自动估计图像的歧义，并根据歧义进行分类或聚类。 DC3本质上是普遍的，因此除了许多半监督学习（SSL）算法外，还可以使用它。平均而言，这会导致分类的F1得分高7.6％，而在多个评估的SSL算法和数据集中，簇的内距离降低了7.9％。最重要的是，我们给出了概念验证，即DC3的分类和聚类是对此类模棱两可标签的手动完善的建议。总体而言，SSL与我们的方法DC3的组合可以在注释过程中更好地处理模棱两可的标签。

Iterative detection and decoding (IDD) is known to achieve near-capacity performance in multi-antenna wireless systems. We propose deep-unfolded interleaved detection and decoding (DUIDD), a new paradigm that reduces the complexity of IDD while achieving even lower error rates. DUIDD interleaves the inner stages of the data detector and channel decoder, which expedites convergence and reduces complexity. Furthermore, DUIDD applies deep unfolding to automatically optimize algorithmic hyperparameters, soft-information exchange, message damping, and state forwarding. We demonstrate the efficacy of DUIDD using NVIDIA's Sionna link-level simulator in a 5G-near multi-user MIMO-OFDM wireless system with a novel low-complexity soft-input soft-output data detector, an optimized low-density parity-check decoder, and channel vectors from a commercial ray-tracer. Our results show that DUIDD outperforms classical IDD both in terms of block error rate and computational complexity.

Cutting planes are a crucial component of state-of-the-art mixed-integer programming solvers, with the choice of which subset of cuts to add being vital for solver performance. We propose new distance-based measures to qualify the value of a cut by quantifying the extent to which it separates relevant parts of the relaxed feasible set. For this purpose, we use the analytic centers of the relaxation polytope or of its optimal face, as well as alternative optimal solutions of the linear programming relaxation. We assess the impact of the choice of distance measure on root node performance and throughout the whole branch-and-bound tree, comparing our measures against those prevalent in the literature. Finally, by a multi-output regression, we predict the relative performance of each measure, using static features readily available before the separation process. Our results indicate that analytic center-based methods help to significantly reduce the number of branch-and-bound nodes needed to explore the search space and that our multiregression approach can further improve on any individual method.

This paper introduces supervised machine learning to the literature measuring corporate culture from text documents. We compile a unique data set of employee reviews that were labeled by human evaluators with respect to the information the reviews reveal about the firms' corporate culture. Using this data set, we fine-tune state-of-the-art transformer-based language models to perform the same classification task. In out-of-sample predictions, our language models classify 16 to 28 percent points more of employee reviews in line with human evaluators than traditional approaches of text classification.

The NASA Astrophysics Data System (ADS) is an essential tool for researchers that allows them to explore the astronomy and astrophysics scientific literature, but it has yet to exploit recent advances in natural language processing. At ADASS 2021, we introduced astroBERT, a machine learning language model tailored to the text used in astronomy papers in ADS. In this work we: - announce the first public release of the astroBERT language model; - show how astroBERT improves over existing public language models on astrophysics specific tasks; - and detail how ADS plans to harness the unique structure of scientific papers, the citation graph and citation context, to further improve astroBERT.

The well-documented presence of texture bias in modern convolutional neural networks has led to a plethora of algorithms that promote an emphasis on shape cues, often to support generalization to new domains. Yet, common datasets, benchmarks and general model selection strategies are missing, and there is no agreed, rigorous evaluation protocol. In this paper, we investigate difficulties and limitations when training networks with reduced texture bias. In particular, we also show that proper evaluation and meaningful comparisons between methods are not trivial. We introduce BiasBed, a testbed for texture- and style-biased training, including multiple datasets and a range of existing algorithms. It comes with an extensive evaluation protocol that includes rigorous hypothesis testing to gauge the significance of the results, despite the considerable training instability of some style bias methods. Our extensive experiments, shed new light on the need for careful, statistically founded evaluation protocols for style bias (and beyond). E.g., we find that some algorithms proposed in the literature do not significantly mitigate the impact of style bias at all. With the release of BiasBed, we hope to foster a common understanding of consistent and meaningful comparisons, and consequently faster progress towards learning methods free of texture bias. Code is available at https://github.com/D1noFuzi/BiasBed

深度神经网络端对端训练有素，将（嘈杂）图像映射到干净的图像的测量值非常适合各种线性反问题。当前的方法仅在数百或数千张图像上进行训练，而不是在其他领域进行了数百万个示例。在这项工作中，我们研究是否可以通过扩大训练组规模来获得重大的性能提高。我们考虑图像降解，加速磁共振成像以及超分辨率，并在经验上确定重建质量是训练集大小的函数，同时最佳地扩展了网络大小。对于所有三个任务，我们发现最初陡峭的幂律缩放率已经在适度的训练集大小上大大减慢。插值这些缩放定律表明，即使对数百万图像进行培训也不会显着提高性能。为了了解预期的行为，我们分析表征了以早期梯度下降学到的线性估计器的性能。结果正式的直觉是，一旦通过学习信号模型引起的误差，相对于误差地板，更多的训练示例不会提高性能。